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On Compress-Forward without Wyner-Ziv 
Binning for Relay Networks 

Peng Zhong, Ahmad Abu Al Haija, and Mai Vu 
Abstract 

Noisy network coding is recently proposed for the general multi-source network by Lim, Kim, El Gamal and 
Chung. This scheme builds on compress-forward (CF) relaying but involves three new ideas, namely no Wyner-Ziv 
binning, relaxed simultaneous decoding and message repetition. In this paper, using the two-way relay channel as the 
underlining example, we analyze the impact of each of these ideas on the achievable rate region of relay networks. 

First, CF without binning but with joint decoding of both the message and compression index can achieve a 
larger rate region than the original CF scheme for multi-destination relay networks. With binning and successive 
decoding, the compression rate at each relay is constrained by the weakest link from the relay to a destination; but 
without binning, this constraint is relaxed. Second, simultaneous decoding of all messages over all blocks without 
uniquely decoding the compression indices can remove the constraints on compression rate completely, but is still 
subject to the message block boundary effect. This boundary effect is caused by the decoding of signal received in 
the last block, in which not all inputs and outputs may be regularly involved. Third, message repetition is necessary 
to overcome this boundary effect and achieve the noisy network coding region for multi-source networks. The rate 
region is enlarged with increasing repetition times. 

We also apply CF without binning specifically to the one-way and two-way relay channels and analyze the rate 
regions in detail. For the one-way relay channel, it achieves the same rate as the original CF and noisy network 
coding but has only 1 block decoding delay. For the two-way relay channel, we derive the explicit channel conditions 
in the Gaussian and fading cases for CF without binning to achieve the same rate region or sum rate as noisy network 
coding. These analyses may be appealing to practical implementation because of the shorter encoding and decoding 
delay in CF without binning. 

Index Terms 

Compress-forward relaying, noisy network coding, Wyner-Ziv binning, joint decoding, message repetition, two- 
way relay channel. 

I. Introduction 

The relay channel (RC) first introduced by van der Meulen ||T| consists of a source aiming to communicate with 
a destination with the help of a relay node. Relay channels can be extended to relay networks, in which each node 
wishes to send a message to some destinations while also acting as a relay for others. Several relay strategies 
including decode-forward, compress-forward and ampUfy-forward have been proposed for the relay channel. In this 
paper, we focus on compress-forward based strategies, analyze its variants and applications to the one-way, two-way 
relay channels and the general relay networks. 

The authors are with Department of Electrical and Computer Engineering, McGill University, Montreal, Canada (e-mails: 
peng.zhong@mail.mcgill.ca; ahmad.abualhaija@mail.mcgill.ca; mai.h.vu@mcgill.ca). 
A part of this paper was presented at the Allerton conference, Sept 2011. 
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A. Related work 

We first review related works on compress-forward (CF) strategies for relay channels and networks. We divide 
the discussion into three parts. The first part is on single-source, single-destination relay networks. The second 
part is on some variants of the CF scheme. The third part is on multi-source multi-destination relay networks. We 
attempt to make this review compressive but do not claim it to be exhaustive of existing works. 

1) Single-source single-destination relay networks: In the following works, the source and relay encoding are 
similar. At each block, the source sends a different message; the relay first compresses its received signal then uses 
Wyner-Ziv binning to reduce the forwarding rate. The differences are mainly in the decoding at the destination by 
either performing successive or joint decoding. 

• Compress-forward is originally proposed for the 3-node single-relay channel (also called the one-way relay 
channel) by Cover and El Gamal in Q. The source sends a new message at each block using independent 
codebooks. The relay compresses its noisy observation of the source signal and forwards the bin index of the 
compression to the destination using Wyner-Ziv coding |j3). A 3-step sequential decoding is then performed 
at the destination. At the end of each block, the destination first decodes the bin index, then decodes the 
compression index within that bin, and at last uses this compression index to decode the message sent in the 
previous block. The following rate is achievable with the 3-step sequential decoding CF scheme; 

R<IiX;YX\Xr) (1) 

subject to 

I{Xr;Y)>I{Yr;Yr\Xr,Y). 

for some p{x)p{Xr)piyr\yr, Xr)piy,yr\x, Xr)- 

• El Gamal, Mohseni, and Zahedi put forward a 2-step decoding CF scheme in |4|. The source and relay perform 
the same encoding as that in |2|. The destination, however, decodes in 2 sequential steps. At the end of each 
block, it decodes the bin index first, then decodes the message for some compression indices within that bin 
instead of decoding the compression index precisely. With this 2-step decoding CF scheme, the following rate 
is achievable: 

R < mm{I{X, Xr-, Y) - Yr\X, X,, F), I{X- Y, Yr\Xr)} (2) 

for some p[x)p{xr)p{yr\yr, Xr)p{y, yr\x, Xr)- It has been shown Q |[5] that this 2-step decoding CF achieves 
the same rate as the original 3-step decoding CF in ([TJ but has a simpler representation. 

• Kramer, Gastpar, and Gupta extend the 3-step decoding CF scheme to the single-source, single-destination and 
multiple-relay network in Q. The relays can also cooperate with each other to transmit the compression bin 
indices by partially decoding these bin indices. 

• Chong, Motani and Garg propose two coding schemes for the one-way relay channel combining decode-forward 
and compress-forward in |^. Similar to the original combined scheme in |j2], the source splits its message into 
two parts and the relay decode-forwards one part and compress-forwards the other The destination, however, 
performs backward decoding either successively or simultaneously. These two strategies achieve higher rates 
than the original combined strategy in Q for certain parameters of the Gaussian relay channel. 

2) Variants of compress-forward: Several variants of the CF scheme have been proposed for the relay channel. 
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• Cover and Kim propose a hash-forward (HF) scheme for the deterministic relay channel in |8|, in which the 
relay hashes (randomly bins) its observation directly without compression and forwards the bin index to the 
destination. HF achieves the capacity of the deterministic relay channel. Kim then proposes an extended hash- 
forward (EHF) scheme in l9\ which allows the destination to perform list decoding of the source messages 
for the general non-deterministic case. 

• Razaghi and Yu introduce in pO) a generalized hash-forward (GHF) relay strategy which allows the relay to 
choose a description of a general form rather than direct hashing (binning) of its received signal, but with 
a description rate on the opposite regime of Wyner-Ziv binning. The destination then performs list decoding 
of the description indices. GHF achieves the same rate as the original CF for the one-way relay channel but 
have been shown to exhibit advantage for multi-destination networks by allowing different description rates to 
different destinations | [TT[ . 

• Recently a new notion of quantize-forward or CF without binning emerges p2| p3) in which the relay 
compresses its received signal but forwards the compression index directly without using Wyner-Ziv binning. 
We discuss this idea in more details in the next few paragraphs. 

3) Multi-source multi-destination relay networks: Relatively fewer works have applied CF to the general multi- 
source multi-destination relay network. 

• Rankov and Wittneben applied the 3-step decoding CF scheme to the two-way relay channel (TWRC) in | [T4) , 
in which two users wish to exchange messages with the help of a relay. The encoding and decoding are similar 
to those in Q. 

• Recently, Lim, Kim, El Gamal and Chung put forward a noisy network coding scheme (12\ for the general 
multi-source noisy network. This scheme involves three key new ideas. The first is message repetition, in which 
the same message is sent multiple times over consecutive blocks using independent codebooks. Second, each 
relay does not use Wyner-Ziv binning but only compresses its received signal and forwards the compression 
index directly. Third, each destination performs simultaneous decoding of the message based on signals received 
from all blocks without uniquely decoding the compression indices. Noisy network coding simplifies to the 
capacity-achieving network coding for the noiseless multicast network. Compared to the original CF, it achieves 
the same rate for the one-way relay channel and achieves a larger rate region when applied to multi-source 
networks such as the two-way relay channel. However, it also brings more delay in decoding because of 
message repetition. 

4) Analysis of compress-forward schemes: With the above variants and developments on CF relaying, some 
works have analyzed the different ideas in compress-forward. 

• Kim, Skoglund and Caire | [T5| show that without Wyner-Ziv binning at the relay, using sequential decoding at 
the destination incurs rate loss in the one-way relay channel. The amount of rate loss is quantified specifically 
in terms of the diversity-multiplexing tradeoff for the fading channel. 

• Wu and Xie demonstrate in p6) that for single-source, single-destination and multiple -relay networks, using 
the original CF encoding with Wyner-Ziv binning of f2\, there is no improvement on the achievable rate by 
joint decoding of the message and compression indices. To maximize the CF achievable rate, the compression 
rate should always be chosen to support successive decoding. 

• Wu and Xie then propose in p7) for the single-source, single-destination and multiple-relay network a scheme 
that achieves the same rate as noisy network coding p2| but with the simpler classical encoding of Q and 
backward decoding. The backward decoding involves first decoding the compression indices then successively 
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decoding the messages backward. It requires, however, extending the relay forwarding times for a number of 
blocks without sending new messages, which causes an albeit small but non-vanishing rate loss. 
Kramer and Hou discuss in p3| a short-message quantize-forward scheme without message repetition or 
Wyner-Ziv binning but with joint decoding of the message and compression index at the destination. It also 
achieves the same rate as the original CF and noisy network coding for the one-way relay channel. This result 
is similar to our result in Section |llj however, they are independent results and we were only aware of the 
work in p3| after pubUshing our conference paper p8|. 



B. Summary of main results 

In this paper, we analyze the impact of each of the 3 new ideas in noisy network coding, namely no Wyner-Ziv 
binning, simultaneous decoding and message repetition. We apply these ideas separately to the one-way, two-way 
relay channels and extend the analysis to the multi-source multi-destination relay network. 

• For the one-way relay channel, we derive the achievable rate using CF without binning (also called quantize- 
forward) but with joint decoding of both the message and compression index. It achieves the same rate as the 
original CF in Q Q. Compared with the original CF, it simplifies relay operation since Wyner-Ziv binning 
is not needed, but increases decoding complexity at the destination since joint decoding instead of successive 
decoding is required. Compared with noisy network coding, it achieves the same rate while having much 
less encoding and decoding delay. This part is similar to Kramer and Hou's result in p3| , but is derived 
independently. 

• We next extend CF without binning to the two-way relay channel and derive its achievable rate region. The 
scheme achieves a larger rate region than the original CF | |T4| . With binning and successive decoding, the 
compression rate is constrained by the weaker of the links from relay to two users. But without binning, 
this constraint is relaxed. However, CF without binning generally achieves smaller rate region than noisy 
network coding p2) . In CF without binning, the decoding of the compression index imposes constraints on 
the compression rate. In noisy network coding, the destinations do not decode the compression index explicitly, 
thus removing these constraints. 

• Using the two-way relay channel as the underlining example, we then analyze the effect of each of the three 
new ideas in noisy network coding for the general multi-source multi-destination relay networks. The main 
findings are: 

- No Wyner-Ziv binning requires joint decoding of both the message and compression index at the destination 
for all networks. 

- Comparing with the original CF |2|, no binning but with joint decoding can enlarge the rate region 
for multi-source multi-destination relay networks. This finding is contrary to the case of single-source 
single-destination relay networks in p7) . 

- CF without binning generally achieves a smaller rate region than noisy network coding because of 
constraints on compression rates. Simultaneous decoding over all blocks without explicitly decoding 
compression indices does remove this constraint but is still not enough. This is due to the block boundary 
effect when sending a different message at each block. 

- Message repetition is necessary to achieve the noisy network coding rate region for multi-source networks. 
It helps mitigate the block boundary effect as repetition times increase. To completely eliminate the 
boundary effect as in noisy network coding, however, the repetition times need to approach infinity. 
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Fig. 1. One-way relay channel model. 
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TABLE 1 

Encoding and decoding of CF without binning for the one-way relay channel. 



• We also provide detailed analysis of the achievable rate regions for the Gaussian and fading two-way relay 
channels. Comparing the achievable rate region and the sum rate of the original CF, CF without binning and 
noisy network coding, we derive explicit conditions for which CF without binning achieves the same rate region 
or sum rate as the original CF or noisy network coding. These analyses may have implication in practical 
implementation of CF without binning in these channels. 

II. One-Way Relay Channel 

A. Discrete memoryless one-way relay channel model 

The discrete memoryless one-way relay channel (DM-RC) is denoted by {X x Xr^p{y^yr\x,Xr)^y x y^), as in 
Figure [T] Sender X wishes to send a message M to receiver Y with the help of the relay {Xr,Yr). We consider 
a full-duplex channel in which all nodes can transmit and receive at the same time. 

A (2"^, n, Pe) code for a DM-RC consists of: a message set = [1 : 2"^]; an encoder that assigns a codeword 
a;"(m) to each message m e [1 : 2"-'']; a relay encoder that assigns at time i e [1 : n] a symbol Xri{yl~^) to each 
past received sequence y^T^ E 3^^^; a decoder that assigns a message m or an error message to each received 
sequence e 3^". The average error probability is — Pt{M ^ The rate R is said to be achievable for 
the DM-RC if there exists a sequence of (2"^, n, P^) codes with P^ 0. The supremum of all achievable rates is 
the capacity of the DM-RC. 

B. Achievable rate for compress-forward without binning 

In the original CF scheme Q Q, the source sends a new message in each block. The relay forwards the bin 
index of the description of its received signal. The receiver uses successive decoding to decode the bin index first, 
then decode the message from the sender. Here we analyze a CF scheme in which the relay forwards the index 
of the description of its received signal directly without binning while the receiver jointly decodes the index and 
message at the same time. We show that CF without binning can achieve same rate as the original CF scheme with 
binning. 
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The encoding and decoding of CF without binning are as follows (also see Table We use a block coding 
scheme in which each user sends b — 1 messages over b blocks of n symbols each. 

1) Codebook generation: Fix p{x)p{xr)p{yr\VnXr)- We randomly and independently generate a codebook for 
each block j g [1 : b] as follows. 

• Independently generate sequences x"{mj) ~ n"=iP(^i)' where rrij S [1 : 2"^]. 

• Independently generate 2"^'' sequences ~ IlILi -P(^ri)' where kj^i £ [1 : 2"^'']. 

• For each e [1 : 2"^'], independently generate 2"^'' sequences y"(fcj|fcj_i) ^ YTi^iPiVrilxriikj-i)) 
where e [1 : 2"^-]. 

2) Encoding: The source transmits x'^{mj) in block j. The relay, upon receiving y^ij), finds an index kj such 
that 

(y,"(A:,|fc,_i),2/"(j),^"(fc.-i))eri"), 

where Tj-"^ denote the strong e-typical set ijij. Assume that such kj is found, the relay sends x"{kj) in block j + 1. 

5j Decoding: Assume the receiver has decoded correctly in block j. Then in block j + 1, the receiver finds 
a unique pair of {rhj, kj) such that 

(x;?(%),y"(j + l))eT(") 
and (x"(m,),<(fc,_i),y,"(^,|%_i),2;"0-)) e T^"). 

Theorem 1. Consider a compress-forward scheme in which the relay does not use Wyner-Ziv binning but sends 
the compression index directly and the destination performs joint decoding of both the message and compression 
index. The following rate is achievable for the one-way relay channel: 

R < min{/(X, Xr; Y) - Yr\X, X^, Y),I{X; Y, (3) 

subject to 

I{Xr; Y) + X, Y\Xr) > Yr\Xr) (4) 
for some p{x)p{xr)p{yr\yr,Xr)p{y, yr\x, Xr). 

Proof: See Appendix [A| ■ 



C. Comparison with the original compress-forward scheme 

Theorem 2. Compress-forward without binning in Theorem [7] achieves the same rate as the original compress- 
forward scheme for the one-way relay channel, which is: 

R < mm{I{X, Xr-, Y) - !{%■, Yr\X, Xr., Y),I{X- F, (5) 

for some p{x)p{Xr)p(yr\yr,Xr)p[y,yr\x,Xr). 

Proof: To show that the rate region in Theorem [T] is the same as the rate region in Theorem [2] we need to 
show that constraint Q is redundant. Note that an equivalent characterization of the rate region in Theorem |2] is 
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as follows ||2) g) ||5): 

R< IiX;Y,Yr\Xr) (6) 

subject to 

I{Xr;Y)>IiYr;Yr\Xr,Y) (7) 
for some p{x)p{xr)p{yr\yr,Xr)- Therefore, comparing (j4]) with (|7j, we only need to show that 

IiYr;Yr\Xr,Y) > /(f, ; - /(i; ; X, F . 

This is true since 

I{Yr; Yr\Xr, Y) = /(F,; F„ X\Xr, F) 

= I{X; Yr\Xr, F) + I{Yr.; Yr\X, Xr, Y) 
> I{Yr;Yr\X,Xr,Y) 
= /(F,; X, F, F,|X,) - I{Yr; X, Y\Xr) 
= I{Yr;Yr\Xr) - I{Yr;X,Y\Xr). 

m 

Remark 1. If using successive decoding, the rate achieved by CF without binning is strictly less than that with 
binning. Thus joint decoding is crucial for CF without binning. 

Remark 2. Joint decoding does not help improve the rate of the original CF with binning. 

Remark 3. Binning technique plays a role of allowing successive decoding instead of joint decoding, thus reduces 
destination decoding complexity. However, it has no impact on the achievable rate for the one-way relay channel. 
This effect on decoding complexity is similar to that in decode-forward, in which binning allows successive decoding 
Q while no binning requires backward decoding p9) . 



Remark 4. For the one-way relay channel, CF without binning achieves the same rate region as GHF 1 10|. However, 
GHF differs from CF without binning in that the relay still performs binning. In the decoding of GHF, the destination 
first decode the compression indices into a list, then use this list to help decode the source message. However, in 
CF without binning, the receiver performs joint decoding of the compression index and message. 

Remark 5. The result in Theorem [T] and Theorem |2] is similar to that in p3] by Kramer and Hou, but is derived 
independently; we only realize the work in |13 | after publishing our conference paper fTS]. 

Remark 6. An obvious benefit of this short message CF without binning scheme compared to noisy network coding 
is short encoding and decoding delay. A few other benefits such as low modulation complexity and potential MIMO 
gain are also recognized in p3| . 

Remark 7. For the one-way relay channel, all the following schemes achieve the same rate: the original CF, CF 
without binning (QF), GHF, and noisy network coding. The difference in achievable rate only appears when applying 
to a multi-source and multi-destination network. 
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III. Two-way Relay Channel 
A. Discrete memoryless two-way relay channel model 

The discrete memoryless two-way relay channel (DM-TWRC) is denoted by {XixX2>^'^r,p{yi, y2,yr\xi,X2,Xr),yiX 
3^2 X yr), as in Figure |2] Here xi and yi are the input and output signals of user 1; X2 and y2 are the input and 
output signals of user 2; Xr and are the input and output signals of the relay. We consider a full-duplex channel 
in which all nodes can transmit and receive at the same time. 

A (2"■^l,2"■"^^^,Pe) code for a DM-TWRC consists of two message setsTWi = [1 : 2"-^i] and M2 = [1 : 2"-^=], 
three encoding functions /i i, f2.i, fr,i, i = 1, ■ ■ ■ ,n and two decoding function gi,g2 as follows. 

= /i,i(Mi,rij, . . . , Yi^i_i), i = 1, . . . ,n 
X2.1 = /2,i(M2,F2,i, . . . ,y2,i-i), i = 1, . . . ,ri 

Xr^i /r,'i {^r. It • ■ • : ^7\i— l); ^ 1,...,7Z 

31 : 3^" X A^i ^ A^2 
52 : 3^2' X A^2 Ml 

The average error probability is = Pr{gi{Mi,Y") ^ M2 or g2(-^^2: ^^2") 7^ -^^i}- A rate pair is said to be 
achievable if there exists a (2"^% 2"^^ , n, Pg) code such that Pg ^ as n ^ cx). The closure of the set of all 
achievable rates (^1,^2) is the capacity region of the two-way relay channel. 



B. Achievable rate region for compress-forward without binning 

In this section, we extend CF without Wyner-Ziv binning but with joint decoding of both the message and 
compression index to the two-way relay channel. We then compare the achievable rate region with those by the 
original CF scheme and noisy network coding. Compared with the original CF p4) , CF without binning achieves 
a strictly larger rate region when the channel is asymmetric for the two users. Binning and successive decoding 
constrains the compression rate to the weaker of the channels from relay to two users. But without binning, this 
constraint is relaxed. Compared with noisy network coding, CF without binning achieves a smaller rate region. In 
CF without binning, the users need to decode the compression index precisely, which brings an extra constraint on 
the compression rate. However, this precise decoding is not necessary in noisy network coding. 

Before presenting the achievable rate region of CF without binning, we outline its encoding and decoding 
techniques as follows. In each block, each user sends a new message using an independently generated codebook. 
At the end of each block, the relay finds a description of its received signal from both users. Then it sends the 
codeword for the description index at the next block (instead of partitioning the description index into bins and 
sending the codeword for the bin index as in the original CF scheme). Each user jointly decodes the description 



9 



Block 




3 


3 + 1 




Xi 










X2 




x^{m2j) 


2^2(^2^+1) 




Yr 






yr{kj+i\kj) 








a;"(fcj_i) 


Xr{kj) 




Yi 




fcj-li ™2j-l 


k J, 1712 J 




Y2 




fcj_l,TOlj_l 







TABLE II 

Encoding and decoding of CF without binning for the two-way relay channel. 



index and message from the other user based on signals received in both the current and previous blocks. This 
decoding technique is different from that in the original decode-forward scheme, in which each user first decodes 
the bin index from the relay, and then decodes the message from the other user. 

Specifically, we use a block coding scheme in which each user sends 6—1 messages over h blocks of 71 symbols 
each (also see Table 

1) Codebook generation: Fix joint distribution p{xi)p{x2)p{xr)p{yr\xrTyr)- Randomly and independently gen- 
erate a codebook for each block j e [1 : b] 

• Independently generate 2^^^ sequences a:"(mij) ^ YYi=iP{xii), where mi.j G [1 : 2"^^]. 

• Independently generate 2^^^ sequences X2{7n2j) ^ Y[i=iPi^^i)' where m2.j G [1 : 2"^^]. 

• Independently generate 2"-'^'' sequences x"(fcj_i) ^ YVi=iPi^ri), where fcj_i £ [1 : 2"-^'']. 

• For each fcj_i £ [1 : 2"^"^], independently generate 2"^'' sequences y^{kj\kj^i) ^ Yii=iPiyri\xri(kj-i)), 
where k^ £ [1 : 2"-^-]. 

2) Encoding: User 1 and user 2 respectively transmit Xi{mij) and X2{i7i2,j) in block j. The relay, upon 
receiving y^U), finds an index kj such that 

{y-ik,\k,.,),y:^{j),x-{k,^,))£Ttl 

Assume that such kj is found, the relay sends x'^{kj) in block j + 1. 

3) Decoding: : We discuss the decoding at user 1. Assume user 1 has decoded kj-i correctly in block j. Then 
in block j + 1, user 1 finds a unique pair of {m2.j, kj) such that 

(x^(m2,,),<(^,_i),y,"(%|Vi),yl'0-),<(mi,,)) £ T^") 

and {x^{kj),yi{3 + G T^"). (8) 

Theorem 3. The following rate region is achievable for the two-way relay channel by using compress-forward 
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without binning but with joint decoding: 

R, < min{I{X,;Y2,Yr\X2,Xr), (9) 

I{Xi,Xr;Y2\X2) - I{Yr;Yr\Xi,X2,Xr,Y2)} 

R2<mm{I{X2;Y,,Yr\Xi,Xr), 

I{X2,Xr;Yi\Xi) - I{Yr;Yr\Xi,X2,Xr,Yi)} 

subject to 

I{Yr;Yr.\Xi,X2,Xr,Yi) < I{Xr;Yi\Xi) 

I{Yr;Yr.\Xi,X2,Xr,Y2) < I{Xr;Y2\X2) (10) 
for some p{xi)p{x2)p{Xr)p{vl,V2:Vr\xi,X2,Xr)p{yr\Xr, TJr)- 

Proof: See Appendix |B] ■ 

C. Comparison with the original compress-forward scheme 

In this section, we first present the rate region achieved by the original CF scheme for the two way relay channel 
as in [14)|. We then show that CF without binning but with joint decoding can achieve a larger rate region. 

We outline the encoding and decoding techniques of the original CF scheme as follows. In each block, each 
user sends a new message using an independently generated codebook. At the end of each block, the relay finds a 
description of its received signal from both users. Then it partitions the description index into equal-size bins and 
sends the codeword for the bin index. Each user applies 3-step successive decoding, in which it first decodes the 
bin index from the relay, then decodes the compression index within that bin, and at last decodes the message from 
the other user. 

Theorem 4. [Rankov and Wittneben]. The following rate region is achievable for two-way relay channel with the 
original compress-forward scheme: 

Rl<I{Xi-Y2X\X2,Xr) 

R2<I{X2;YiX\Xi,Xr) (11) 

subject to 

Tn&,,(I{Yr;Yr\Xl,Xr,Y^),I{Yr;Yr\X2,Xr,Y2)) 

< min(/(X,; Y,\X,)., I{Xr; Y2\X2)) (12) 

for some p[xi)p{x2)p{Xr)p{vl,V2,Vr\xi,X2,Xr)p{yr\Xr, Ur)- 

We present a short proof of this theorem in Appendix [C] to show the difference from CF without binning. The 



proof follows the same lines as in [14\ , but we also correct an error in the analysis of p4[ as pointed out in Remark 
21 in Appendix [C] 

Proof: See Appendix [C] ■ 
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Theorem 5. In the two-way relay channel, the rate region achieved by compress-forward without binning in Theorem 
|i] is larger than the rate region achieved by the original compress-forward scheme in Theorem |4] when the channel 
is asymmetric for the two users. The two regions may be equal only if the channel is symmetric, that is the following 
conditions holds: 



I{Xr:Yi\X^) ^ I{Xr;Y2\X2) 

I{Yr; Yr\Xi,Xr, Fl) = I{Yr;Yr\X2,Xr, Y2). 

Furthermore, is only necessary but may not be sufficient^ 



(13) 



Proof First, we show that the constraint on the compression rate of Theorem [5] is looser than that of Theorem 
[4] This is true since from ( [T2] l, we have 

I{Xr;Y^\X^) > I[%;Yr\X^,Xr,Y^) 

= liYr] X2, Yr\Xi, Xr, Yi) 

>IiYr;Yr\X,,X2,Xr,Y,) (14) 



where ( 14 1 is the right-hand-side of the first term in ( 10 1. Similar for the other term. 
Next we show that (111 and ( 12 1 imply (j9]l. From (111, we have 

R2<I{X2;Y,X\XuXr) 

= I{X2 ■,Yi\Xi,Xr)+ X2 |Fi , Xi , X,) 

= /(X2 , X, ; Yi |Xi ) - /(X, ; n I Xi ) + /( t ; ^2 1 Fi , , X,) 

< I{X2,Xr-,Yi\Xi) - I(Yr-,Yr\Xi,Xr,Yi) + I{Yr-,X2\Y^,Xi,Xr) 
= I{X2,Xr;Yi\X^) - I{Yr;Yr\Xi,X2,Xr,Y^) 

where (a) follows from the constraint of (12i in Theorem |4] The equality holds when 

I{Xr; nlXi) - min{/(X,; FilXi), /(X,; ^21X2)} 
^I{Yr;Yr\X^,Xr,Yi) 

= UV&^{I{%-Yr\X^,Xr,Y^),I{Yr;Yr\X2,Xr,Y2)). 

Similar for the equality holds when 

I{Xr; Y2\X2) = min{/(X,; Yi\Xi), I{Xr;Y2\X2)} 

= I{Yr;Yr\X2,Xr,Y2) 

^ina,i{I{Yr;Yr\Xi,Xr,Yi),I{Yr;Yr\X2,Xr,Y2)). 

The above analysis shows that at the boundary of the compression rate constraint ( [T2] i, the rate region of CF without 
binning (|9| is equivalent to that of the original CF ( [TT] i. However, since constraint ( [Tol l is loser than ([12]), the rate 
region in Theorem [3] is larger than that in Theorem |4] Only if condition (13i holds, the original CF scheme may 

'in jisj, we stated condition \\3) as "if and only if. but it should be corrected as "only if. The proof remains the same. 
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achieve the same rate region as CF without binning; otherwise, its rate region is strictly smaller ■ 

Remark 8. For the two-way relay channel, binning and successive decoding constrains the compression rate to the 
weaker of the channels from relay to two users. But without binning, this constraint is relaxed. Thus CF without 
binning achieves a larger rate region than the original CF scheme when then channel is asymmetric for the two 
users. 



D. Comparison with Noisy Network Coding 

In this section, we compare the rate region achieved by CF without binning with that by noisy network coding 
| [T2| for the two way relay channel. The main differences between these two schemes are as follows. In CF without 
binning, different messages are sent over different blocks, but in noisy network coding, the same message is 
sent in multiple blocks using independent codebooks. Furthermore, in noisy network coding, each user performs 
simultaneous joint decoding of the message based on signals received from all blocks without uniquely decoding 
the compression indices (i.e. relaxed joint decoding). But in CF without binning, each user jointly decodes both 
the message and compression index precisely based on signals received from the current and previous blocks. 

Theorem 6. [Lim, Kim, El Gamal and Chung]. The following rate region is achievable for the two-way relay 
channel with noisy network coding: 

Ri < min{I{Xi;Y2,Yr\X2,Xr), (15) 

I{Xi,Xr;Y2\X2) - I{Yr;Yr\Xi,X2,Xr,Y2)} 

R2 < mm{IiX2;Yi,Yr\Xi,Xr), 

I{X2,Xr;Yi\Xi) - I{Yr;Yr\Xi,X2,Xr,Yi)} 
for some p{xi)p{x2)p{Xr)p{Vl,y2,yr\xi,X2,Xr)p{yr\Xr, Ur)- 

Comparing Theorem |3] with Theorem |6] we find that the rate constraints (j9]) for Ri and i?2 in CF without binning 
are the same as those in noisy network coding ( [T5] l. However, CF without binning has an extra constraint on the 
compression rate ( [T0| . Therefore, in general, CF without binning achieves a smaller rate region than noisy network 
coding. Sections [V] and VI show that for the Gaussian and fading two-way relay channels, these two schemes 



achieve the same rate region or sum rate for certain channel configurations. 

Remark 9. In noisy network coding, the combination of message repetition and relaxed joint decoding is necessary 
in addition to compress-forward without binning to achieve a better rate region than that in Theorem [3] for the 
TWRC. 



IV. Implication for Relay Networks 
From the discussion for the one-way and two-way relay channels, we can acquire some implications for the 
general relay networks. A TV-node discrete memoryless relay network (HaLi ^k,p{yN\xN), Xi^iJ^fc) is depicted 
in Figure [3] It consists of N sender-receiver alphabet pairs {Xk,yk), k <E [1 : N] and a collection of conditional 
pmfs p{yi, ■ ■ ■ yN\xi, ■ ■ ■ xn)- Each node k E [1 : N] wishes to send a message Mk to a set of destination nodes, 
while also acting as a relay for messages from other nodes. 
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Fig. 3. Relay network model. 



Noisy network coding is proposed for the general relay network in |12|. Three new ideas are used in noisy 
network coding. One is no Wyner-Ziv binning in relay operation. Another is simultaneous joint decoding of the 
message over all blocks without uniquely decoding the compression indices. Last is message repetition, in which 
the same message is sent in multiple blocks using independent codebooks. Next, we discuss the effect of each of 
these ideas separately. 

A. Implication of no Wyner-Ziv binning 

Generalizing from the two-way relay channel, we can conclude that CF without binning achieves a larger rate 
region than the original CF scheme for networks with multiple destinations. With binning and successive decoding. 



the compression rate is constrained by the weakest link from a relay to a destination, as in (65 i. But with joint 
decoding of the message and compression indices, this constraint is more relaxed since each destination can also 
use the signals received from other links, including the direct links, to decode the compression indices and provides 
relays more freedom to choose the compression rates. This explains why for the two-way relay channel, the constraint 



on compression rate in CF without binning (10 1 is looser than that in the original CF scheme ( 12 1. Therefore, with 
joint decoding, Wyner-Ziv binning is not necessary. No binning also simplifies relay operation. 

Remark 10. Joint decoding of both the message and compression index is crucial for CF without binning. Without 
joint decoding, it achieves strictly smaller rate than the original CF with binning for any network. 

B. Implication of joint decoding without explicitly decoding compression indices 

A difference between CF without binning and noisy network coding comes from the decoding of the compression 
indices. For both schemes, the compression rate at a relay is lower bounded by the covering lemma. But in noisy 
network coding, each destination does not decode the compression indices explicitly, hence there are no additional 
constraints on the compression rate. However, in CF without binning, each destination decodes the compression 
indices precisely; this decoding places extra upper bounds on the compression rate, leading to the constraints on 
compression rate as in ([TOji. 

The above analysis prompts the question: what if in CF without binning, we also do not decode the compression 
index precisely, can we achieve the same rate region as noisy network coding? The following analysis shows that 
the answer is negative. Take the two-way relay channel as an example. In the next few sections, we apply several 
joint decoding rules to enlarge the rate region. 
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1 ) Relaxed joint decoding of a single message without decoding the compression indices uniquely: Using the 



same codebook generation and encoding as in CF without binning in Section III-B but we change the decoding 
rule in (|8]l to as follows. In block j + 1, user 1 finds a unique such that 

(x^(m2,,0,4'(%-i),y"(%l^.-i),yr(j),a;r(mi,,)) e ri") 

and {x^^{k,),yl{3 + 1), .T'/(mi,,+i)) & T^i"^ (16) 

for some pair of indices With this decoding rule, the error event which corresponds to wrong 

compression index only (see Appendix [b| no longer applies, but other new error events appear in which ^ 1 
(see the detailed error analysis in Appendix |D]). With decoding rule ([T6|, we have following Corollary: 

Corollary 1. For the two-way relay channel, the following rate region is achievable by CF without binning using 
joint decoding but without decoding the compression index precisely: 

Rl<I{Xi-Y2,Yr\X2,Xr) (17a) 

Ri < I{Xi,Xr;Y2\X2) - I{%;Yr\X^,X2.Xr,Y2) (17b) 

Rl < I{Xi,Xr; Y2\X2) - I{Yr;Yr\X^,X2,Xr,Y2) + I{Xr; Y2\X2) - I{Y- Y2\Xr) (17c) 

R2<I{X2;YiX\XuXr) {lid) 
R2 < I{X2,Xr;Y^\Xi) - I{Yr;Yr\X^,X2,Xr,Y^) (17e) 
R2 < HX2,Xr; Y,\X,) - IiYr;Yr\X,,X2,Xr, Fi) + nXr-, Y,\X,) - I(Y- Y^\Xr) (17f) 

for some p{xi)p{x2)p{Xr)p{Vl,y2,yr\xi,X2,Xr)p{yr\Xr, Ur)- 

Proof: See Appendix [D| ■ 
In above rate region, although the new decoding rule ( [T6| ) removes the constraint on compression rate, it brings 
two new rate constraints ( |17c[ ) ( |17f| i. Hence the rate region in (Vf) is still smaller than that of noisy network coding 
in ( 15 I. These two extra rate constraints come from the block boundary condition when performing joint decoding 
over two blocks. Specifically, it corresponds to the error event E-jj in Appendix [D] in which all the compression 
indices and message are wrong. The boundary condition results from the second decoding rule in ( [T6] l in which 
not all input and output signals are involved. 

2) Simultaneous joint decoding of all messages without decoding compression indices uniquely: To reduce 
the boundary effect, we try simultaneous decoding of all messages over all blocks, again without decoding the 
compression indices uniquely. We use the same codebook generation and encoding as in CF without binning in 



Section III-B but use a different decoding rule at the destination. The destination now jointly decodes all messages 
based on the signals received in all blocks, without decoding the compression indices explicitly. Specifically, user 
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1 now finds a unique tuple (m2.i, . . . m2j, ■ ■ ■ "i2,b-i) at the end of block b such that 

(x5(™2,i),<(l),y"(fci|l),yi(l),2;?(mia)) G Ti") (18a) 

(x5(™2,,),x:?(fc,_i),y,"(fc,|fc,_i),yl'(j),<(mi,,)) € 

(x5(™2,fc-i), a;;?(fcfc_2), y"(fcfc-i|A:b_2), y" (6 - 1), (mi,6_i)) e T]") (18b) 
(a:^(l),4'(fc,_i),y,"(fc,|fc,_i),yl'(6),xr(l)) S T^") (18c) 

for some indices (fci, . . .kj, . . . fc;,_i, fcf,). 

To compare its achievable rate region with noisy network coding, we consider the error event in which m2,i and 
fcfc are wrong while all other messages and indices are right. This error event involves the decoded joint distributions 
from ( |18a| l and ( |18c| l as follows. 

p{Xi)p{x2)p{Xr)p{yi,yr\Xl,Xr) 
p{xi)p(x2)p{Xr)p[yr\Xr)p{yi \xi,X2, Xr) 

By the packing lemma, the probability of the above error event goes to zero as n ^ oo if 

R2+ Rr < I{X2;YuYr\Xi,Xr) + I{Yr;XuX2,Y^\Xr) (19) 

Since Rr > I(Yr',Yr\Xr) by the covering lemma ||^, we obtain 

i?2 < I{X2 ■,Yi,Yr\Xu Xr) + I {% ; , ^2 , Fl - I{Yr; Yr\Xr) 

= / (^2 ; Fi , y, I , X,, ) - / ; y,, I , , X, , Fi ) (20) 

which is tighter than the constraint ([Tsj in noisy network coding. Again we see the boundary effect at the last block 
when is wrong. 

3} Simultaneous joint decoding of all messages but ignoring the last compression index: Since in the last block, 
each source sends a known message, the last compression index k^ brings no new information. Hence we may 
choose to omit it in the decoding rule to see if the rate region can be improved. Specifically, user 1 now finds a 
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unique tuple {m^^i, ■ ■ ■ n^2j: • ■ • "^2.6-1) at the end of block b such that 

(x5(™2a),<(l),y"(fci|l),yi(l),2;?(mia)) GTi") (21a) 
(a;5(m2,2),x:?(fci),y,"(fc2|fci),yr(2),<(™i,2)) e Ti") 

(x5(™2,,),x:?(fc,_i),y,"(fc,|fc,_i),yl'(j),<(mi,,)) € 

(x5(™2,fc-i), a;;?(fcfc_2), y"(fcfc-i|A:b_2), y" (6 - 1), (mi,6_i)) e T]") (21b) 
(a:^(l),4'(fc,_i), S tJ") (21c) 

for some indices (fci, . . .kj, . . . fc;,_i). Note that ( |21c| i is the only step that is different from ( |18c| l. 

To compare its achievable rate region with noisy network coding, we consider the error event in which 7712,1 
and fcf,_i are wrong while all other messages and indices are right. This error event involves the decoded joint 
distributions from ( |21a| i, ( |21b| ) and ( |21c| l as follows. 

p{xi)p{x2)p{Xr)p{yi,yr\Xl,Xr) 
p{xi)p(x2)p{Xr)p[yr\Xr)p{Vl \xi,X2, Xr) 
p{xi)p{x2)p{Xr)p{yi\xi,X2) 

By the packing lemma, the probability of the above error event goes to zero as n 00 if 

R2+Rr< IiX2:Yi,Yr\XuXr.)+I{Xr;Yi\Xi,X2)+I{Yr;Xi,X2,Yi\Xr.). 

Since Rr > I{Yr',Yr\Xr), we obtain 

R2 < I{X2;Y,,Yr\Xi,Xr) + I{Xr; Y,\X,,X2) + Hp, X,,X2,Y,\Xr) - Yr\Xr) 

= I{X2;YiX\Xi,Xr) + I{Xr; Yi X2) - X2, X,, Fi) (22) 

Although rate constraint ( |22] i is loser than pO] ), it is still tighter than the rate constraint of noisy network coding 
in ( [T5| ) (we can easily check this for the Gaussian TWRC). Therefore, simultaneous decoding of all messages over 
all blocks still achieves a smaller rate region than noisy network coding. 

Remark 11. Joint decoding without explicitly decoding the compression indices removes the constraints on com- 
pression rates but still achieves a smaller rate region than noisy network coding for the general multi-source network. 

Remark 12. Simultaneous joint decoding of all messages over all blocks still does not overcome the block boundary 
limitation, caused by the last block in which no new messages but only the compression indices are sent. 

Remark 13. In |17|, a technique of appending AI blocks for transmission of the compression indices only is 
proposed to reduce the block boundary effect, but it also reduces the achievable rate by a non-vanishing amount. 

The above analysis leads us to discuss the effect of message repetition, in which the same message is transmitted 
over multiple blocks. 
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Block 




2j-l 


2j 


2j + l 




Xi 




2;i,2j-l("^'l,j) 


2;i,2j("llj) 


a;"2j + l(™lj + l) 




X2 




4'.2j-l("^'2,j) 


4',2j("^2j) 


a;2,2i + l(™2j + l) 




Yr 




Vr{k2j-l\k2]-2) 


Vr{k2j\k2]-l) 


yr(fei + l|A:2j) 




Xr 




a:"(fc2j_2) 




Xr{k2]) 




Yi 




7712 j-i for some (^2^-4,^2^-3,^2^-2) 




m2,j for some (^2^-2,^2^-1,^2^) 




Y2 




?7iij_i for some (^2^-4,^2^-3,^2^-2) 




mij for some (fc2j-2, ^2j-i, ^2^) 





TABLE III 

Encoding and decoding of CF witliout binning but with twice message repetition for the two-way relay channel. 



C. Implication of message repetition 

Message repetition is performed in noisy network coding by sending the same message in multiple, consecutive 
blocks using independent codebooks. To understand the effect of message repetition, we use the same decoding rule 
as in the previous section (decoding the message without explicitly decoding the compression indices) and repeat 
the message twice. Now each user transmits the same message in every two consecutive blocks. We compare the 
achievable rate region of this scheme with those of no message repetition and of noisy network coding, in which 
each message is repeated b times and b approaches to infinity. 

Again take the two-way relay channel as an illustrative example. Let each user transmit the same message in 
every two blocks using independent codebooks. Decoding is performed at the end of every two blocks based on 
signals received from the current and previous two blocks. Specifically, the codebook generation, encoding and 



decoding are as follows (also see Table III 1. We use a block coding scheme in which each user sends b messages 
over 2b + 1 blocks of n symbols each. 

1) Codebook generation: At block I G {2j — 1, 2j}: 

• Independently generate 2"^^^ sequences a::";(mij) ^ nr=iP(^i*)' where mi.j e [1 : 2"^^^]. 

• Independently generate 2"^^^ sequences X2 i{m2j) ~ nr=i^'(^2i), where m2.j G [1 : 2"^^^]. 

• Independently generate 2"-'^'' sequences x^{ki) ~ YVi=iPi-'^ri), where A:; G [1 : 2"^*^]. 

• For each ki e [1 : 2"^"^], independently generate 2"^'' sequences y^{ki+i\ki) ~ ]Xi=iP{yri\xriiki)), where 
ki+i e [1 : 2"«'-]. 

2) Encoding: In blocks 2j — 1 and 2j, user 1 transmits 2j-i{''ni,j) and a;"2j('T7i,j) respectively. User 2 
transmits a:^2,2i-i('^2,i) and 2:2^2^ ("*2 j)- 

In block j, the relay, upon receiving yr{j), finds an index kj such that 

{y-{k,\k,.,),y-{j),x-{k,^,))eTtl 
Assume that such kj is found, the relay sends x'^{kj) in block j + 1. 
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3) Decoding: We discuss the decoding at user 1. User 1 decodes rn2j at the end of block 2j + 1. Specifically, 
it finds a unique rh2j such that 

K2,-l(^2,,),x;!(fc2,_2),y,"(fc2,_l|fc2,_2),2;r(2j " 1) , <2, -1 ) ) ^ ^i") 

(^2,2, (m2,,0 , < (fc2,- 1 ) , y." (fc2, I fc2, -1 ) , (2j ^ 

and (x;'(fc2,), yr(2j + 1), a.^^^^.+ilmi^.+i)) € T]") (23) 

for some (^2^-2, ^2^-1, ^2^)- 

Corollary 2. For f/ze two-way relay channel, the following rate region is achievable by CF without binning and 
without explicitly decoding tlie compression indices when repeating each message twice: 

Ri<I{X^\Y2X\X2.Xr) (24a) 

Rl < I{Xi,Xr:Y2\X2) ' I{Yr\Yr\X^,X2,Xr,Y2) (24b) 

i?i < I{Xi,Xr;Y2\X2) ~ I{Yr;Yr\X^,X2,Xr,Y2) + ^ [/(X, ; ^2 1^2) " /(F; ^2 1 ^r)] (24c) 

R2<I{X2;Y^X\XuXr) (24d) 

R2 < I{X2,Xr;Yi\Xi) ~ I{%-Yr\X^,X2,Xr,Y^) (24e) 

i?2 < I{X2,Xr; FilXi) - Yr\X^,X2,Xr, Fi) + \ [/(X,; Fi - /(f; mx,)] (24f) 
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/or some p(xi)p(a;2)p(a;r)p(2;i, 2/2, J/rla^i, a;2, a;r)p(yr|a;r, 2/r)- 



Proof: See Appendix [E] ■ 
Comparing the above rate region with that of CF without message repetition in ( [T7| ) and noisy network coding 
in (15 1, we find that the extra rate constraints ( |17c| l and ( |17f[ l are relaxed by repeating the message twice. The 
additional term is divided by 2, which comes from the error event £[q^ in Appendix |Ej in which the message and 
all compression indices are wrong. This event also corresponds to a boundary event, but since decoding rule ( |23| ) 
spans more blocks, the boundary effect is lessen. 

Thus if we repeat the messages h times, this additional term will be divided by b. Taking h to infinity as in noisy 
network coding completely eliminates the additional terms in \2Ac\ and ( |24f| l. Hence the rate region is increasing 
with the number of times for message repetition. To achieve the largest rate region, the message repetition times 
need to be infinity. Therefore, noisy network coding has b blocks decoding delay and b is required to approach 
infinity. 

Remark 14. Message repetition brings more correlation between different blocks. It helps lessen the boundary effect 
when increasing the repetition times. 

Remark 15. Message repetition is necessary for achieving the noisy network coding rate region in multi-source 
networks. Furthermore, the repetition times need to approach infinity. 



Remark 16. This result is different from the single-source single-destination result in |17| which shows backward 
decoding without message repetition achieves the same rate as noisy network coding, albeit at an expense of 
extending the relay forwarding times infinitely without actually sending a new message. Thus message repetition 
appears to be essential in a multi-source network. 
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V. Gaussian Two-way Relay Channel 

In this section, we focus on the Gaussian two-way relay channel. We compare the rate regions of CF without 
binning, the original CF and noisy network coding. We also derive the analytical condition for when CF without 
binning achieves the same rate region or sum rate as noisy network coding. 

As in Figure |4] the Gaussian two-way relay channel can be modeled as: 

Yi ^ 312^2 + girXr + Zi 
Y2 = 921^1 + 92rXr + ^2 

Yr = grlXi + gr2X2 + (25) 

where Zi, Z2, Zr ~ A/^(0, 1) are independent Gaussian noises. The average input power constraints for user 1, user 
2 and the relay are all P. gi2, gir, 921, g2r, gri, gr2 are corresponding channel gains. 

A. Achievable rate region by CF without binning 

In the Gaussian two-way relay channel model, assume 

^AA(0,F),X2 -AA(0,P), 

-7V(0,P),Z -7V(0,cr2), (26) 
where Xi , X2 , and Z are independent, and Yr — Yr ^ Z. Denote 

J2\ _ r< ( „2 D I gr\P 
1+^2 



Ri2{^') = C{gi^P + girP) - C(\lo') 



R2i{a') = C^ji,P+^^ 
i?22(^') = C{gl2P + glrP) - (27) 
where C{x) — \ log(l + x). Then we have following rate region using CF without binning. 

Theorem 7. The following rate region is achievable for the Gaussian two-way relay channel using compress-forward 
without binning: 

Ri <min{i?n((72),i?i2(a2)} 

i?2 <min{i?2l(fT2),i?22(^')} (28) 
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for some > niax{(T^j^, (7^2}' where 



a+9i2P)/i9lP), (29) 



and -Rii(cr ), i?i2((7 ), i?2i(c ), i?22(f ) are as defined in (27). 



Proof: Applying the rate region in Theorem |3] with the signahng in (|26]l, we obtain ( |28] l. ■ 

B. Rate region comparison with the original CF scheme 

We now compare the rate regions of CF without binning in Theorem |7] and the original CF in p?) for the 
Gaussian two-way relay channel. We first present the rate region achieved by the original CF scheme. 

Corollary 3. [Rankov and Wittneben]. The following rate region is achievable for the Gaussian two-way relay 
channel using the original compress-forward scheme: 

R2<R2l{a^) (30) 

for some ct^ > cr^, where 

2 ('^ + gllP + 9rlP '^+9l2P + 9r2P] 

ai = max <^ t^t^, t^t— \ (31) 



and i?ii((T^), i?2i(o'^) (ire as defined in {27\. 



The following result shows the condition for which the original CF achieves the same rate region as CF without 
binning. 

Theorem 8. The original compress-forward scheme achieves the same rate region as compress-forward without 
binning for the Gaussian TWRC if and only if 

9lr = 92r 

9I1+ 9rl^ 9l2+ 9r2- (32) 

Otherwise the rate region by the original compress-forward scheme is smaller 



Remark 17. Condition ( [32| ) for the Gaussian TWRC is both sufficient and necessary, and hence is stricter than the 
result for the DMC case in Theorem [5] which is only necessary. 

Proof: Note that both Rii{a'^), R2i{a'^) in ^ are non-increasing and i?i2(CT^), ^22(0'^) are non-decreasing. 
Let CTgi be the intersection between i?ii(cr^) and i?2i(CT^) (similar for (TI2) as: 

i?n(^?i)=^12(^el) 
i?2l(^e'2)-^22(^,'2)- 
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Then we can easily show that 

<yli = {^ + 9liP + 9liP)/{9lrP) 

^e2 = (1 + 9I2P + 9l2P)K9lrP)- (33) 

Therefore, min{i?ii((T^), i?i2(cr^)} is maximized when ct^ = ali, while min{i?2i(cr^), i?22(o'^)} is maximized 
when — 0^2- Noting that > ali,(j'^ > ^^'^ '^ei ^ '^cij'^e2 — "'02 ' we conclude that the rate region in 
Theorem I?] is the same as that in Corollary |3] if and only if a^. = (i^^ = From this equality, we obtain the 
result in Theorem |8] ■ 

C. Rate region comparison with Noisy Network Coding 



We next compare the rate regions of CF without binning and noisy network coding 1 12 1 for the Gaussian two-way 
relay channel. We first present the rate region achieved by noisy network coding. 

Corollary 4. [Lim, Kim, El Gamal and Chung]. The following rate region is achievable for the Gaussian two-way 
relay channel with noisy network coding: 

i?i <min{i?n(fT'),i?i2('T')} 

i?2 <min{i?2i((T2),i?22(a2)} (34) 
for some ct^ > 0, where i?ii((T^), i?i2(o'^), i?2i(o'^), ^22(0'^) are defined in {27). 



The following result shows the condition for which CF without binning achieves the same rate region as noisy 
network coding. 

Theorem 9. Compress-forward without binning achieves the same rate region as noisy network coding for the 
Gaussian TWRC if and only if 

^c'2 < '^li, (35) 



where a^^ , (Tg2 are defined in ( 33 \ and a'^i , a^2 are defined in { 29 ). Otherwise, the rate region by compress-forward 
without binning is smaller 

Proof: Similar to the proof of Theoremjs] note that both _Rii(o'^), i?2i(o'^) are non-increasing and i?i2(o'^), i?22(o'^ 
ai^e non-decreasing. Also, 

i?n(^?i)=^12(^el) 
i?2l(^e'2)-^22(^,'2)- 

Therefore, the constraint in Theorem |7] is redundant if and only if 

max{cr2^,cr^J < minjcj^^ , (7^2}. (36) 
Since cr^i < and cr^2 ^ '^^2 always hold, the above condition (36i is equivalent to (35i. ■ 



Remark 18. If condition ([32|) holds, then condition (pSj) also holds. Thus when the original CF achieves the same 
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rate region as CF without binning, it also achieves the same rate region as noisy network coding for the Gaussian 
TWRC. 

Figure |5] shows an asymmetric channel configuration in which CF without binning achieves a strictly larger rate 
region than the original CF scheme, but strictly smaller than noisy network coding. Figure |6] shows a case that CF 
without binning achieves the same rate region as noisy network coding and larger than CF with binning. 

D. Sum rate comparison with Noisy Network Coding 

We notice that in some cases, even though CF without binning achieves smaller rate region than noisy network 
coding, it still has the same sum rate. Thus we are interested in the channel conditions under which CF without 
binning and noisy network coding achieve the same sum rate. 

Without loss of generality, assume a^i > in ( |33l ). First we analytically derive the optimal cr^ that maximizes 

the sum rate of noisy network coding. 
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Corollary 5. Let ct^ denotes the optimal that maximizes the sum rate of the Gaussian TWRC using noisy 
network coding. Define aff^ and aj^2 follows: 

• r 2 \ 2 \ 2 2 2 

if > c^ei or al < 0, = ct^i; 

i/a22>a2>0, ^i^af^; (37) 

2 \ 2 \ 2 2 2 
'/o-g > or (T^ < 0, a%2 = Cr^l ; 

i/a2,>a2>0, (72,2=^2,, (38) 



where 



2 ^ 9j2P±9v2P+± 

1 



Then, 



if R2l{(^l2) < ^12(^^2) + ■R2i(ct?/2)7 CTat = CT^2; 

?/i?2l(^7e2) > ^12^2) + i?2lK2), = f^e2 • (39) 



Proof See Appendix |F-A 



Based on Theorem |7] and Corollary |5] we now obtain the following result on the conditions for CP without 
binning to achieve the same sum rate as noisy network coding for the Gaussian TWRC. 

Theorem 10. Compress-forward without binning achieves the same sum rate as noisy network coding for the 
Gaussian TWRC if and only if cr^i < cr^, where a^i is defined in [29) and aj^ is defined in Corollary^ Otherwise, 
the sum rate achieved by compress-forward without binning is smaller 

Proof: According to Corollary [s] the sum rate of noisy network coding is maximized when — afj. According 
to Theorem I?] for CF without binning, the constraint on is > a^i (since we assume a^^ > 0^2)- Therefore, 
compress-forward without binning achieves the same sum rate as noisy network coding if and only if the constraint 
region > <j1i contains cr^, which is equivalent to a^^ < aj^. ■ 
We can apply the above result to the special case of 5^1 = gir,gr2 = 52r,.92i = .912 as follows. 

Corollary 6. If gri = gir,gr2 = 32r,52i ~ 512, then compress -forward without binning always achieves the same 
sum rate as noisy network coding. 



Proof: See Appendix F-B 
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Figure |7] plots the sum rates for the same channel configurations as in Figure |5] which shows the sum rates of 
CF without binning and noisy network coding are the same, even though the rate regions are not. 

As confirmed in Figures [5] [6] and [7] CF without binning achieves a larger rate region and sum rate than the 
original CF scheme in |14| when the channel is asymmetric for the two users. CF without binning achieves the 



same rate region as noisy network coding when (35 1 is satisfied and achieves the same sum rate for a more relaxed 



condition. Furthermore, it has less decoding delay which is only 1 instead of b blocks. 

VI. Fading Two-way Relay Channel 

In this section, we derive the ergodic achievable rate regions for the fading two-way relay channel and compare 
them between CF without binning and noisy network coding. Similar to the Gaussian channel, we also derive the 
analytical conditions for when CF without binning achieves the same rate region or sum rate as noisy network 
coding. 

The mathematical model of the fading TWRC channel can be expressed as in pSj l with 

912 



9lr 



9rl 



hi2 


521 = 


h21 


"12 


"l2 


hir 


52r = 


h2r 


"ir 


"2r 




9r2 = 


hr2 


"ir 


"2r 



where d^ is the distance between nodes i and j for G {l,2,r}, a is the pathloss attenuation exponent, hij 
are zero-mean complex Gaussian random variables (which corresponds to Rayleigh fading) and Zi ^ CA/^(0, 1). 
Each hij is independent from the other fading coefficients, all Xi and aU Zi. 



A. Ergodic achievable rate region 

An achievable rate region for the fading TWRC is obtained by incorporating the randomness of the channel gains 
into Theorem [T] The knowledge of fading coefficients available at each node is as follows. 
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• User 1 knows hi2, /iir, h^i and hr2- Hence, the effective output is Yi = [Yi, hi2, /iir, h^i, hr2]- 

• User 2 knows /121, h'2r, hri and hr2- Hence, Y2 — [Y2, h'2r, hri, hr2]- 

• The relay knows hri and hr2- Hence, Yr = [Yr, hri, hr2]- 

In other words, each user knows the hnks from other nodes to itself and all links to the relay, while the relay only 
needs to know the links to itself We assume that each block of length n is long enough to experience all fading 
states such that the ergodic rate can be used. Denote 




(40) 



12\ 



where C(|a;| ) = log(l + \x\ ) and the expectations are taken over the fading parameters hi,j. Then, we obtain the 
following theorem: 

Theorem 11. The following ergodic rate region is achievable for the fading TWRC using CF without binning and 
joint decoding: 

Ri < min(^ii,^i2) 

i?2 < min(i?2i,i?22) (41) 

for some 

CT^ > max(CT,\,a^J (42) 

where 

'^^i- 2/1-1 



and /i, /2, ^11, ^12, -R21, ^22 are defined in ( |40| 
Proof See Appendix [G] 



Remark 19. a in (42 1 is the same as that for the Gaussian channel because it results from the compression rate 
at the relay; however, and ct^^ are different from those for the Gaussian channel because they come from the 
decoding at each user and hence are affected by channel fading. 
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The following Corollary evaluates the expectation of the rate constraints in Theorem 1 1 



Corollary 7. Evaluating the expectation of the rate constraints in Theorem 11 leads to the following expressions: 

2 



i?ll 



Ri 



R21 



R2 



'^U-2^V-2 1 

4^V^ln2(A„, -A„J ' ""^.e 



'"2 

2 



'-'4,6 



'Ml 

2 



'-'4.6 



G' 



6.2 

4,6 



2 



'»2 

2 



X G' 



4.6 



G' 



6.2 

4,6 



47r^7rln2(A„^ - A^J 

w/zere Op = [-0.5,0,0,0.5], bq = [0,0.5,-0.5,0,-0.5,0], G[-] w the Meijer's G-function [20^], and 

" i?[|/l2lP]P' ^" 

A - A 



d" 
"12 


i?[|/^12P 


P' 






E[\hir\^ 


]P' 







E[\K,\^]P' i?[|/l.2P]P 



Proof: See Appendix [H] 



(44) 



(45) 



fi. Rate region comparison with Noisy Network Coding 

The following condition shows when noisy network coding and CF without binning achieve the same rate region 
for the fading TWRC. 

Corollary 8. Compress-forward without binning achieves the same rate region as noisy network region for the 
fading TWRC if and only if 



max{CT^i,cr^J < min{crgi,crg2}. 



(46) 



where cr^i,Cc2 come from ( |43| l; a^i is the intersection between Rn and R12, and intersection between 

R21 and R22 as defined in (|40[). 



Proof: Following the same analysis for the Gaussian channel in Theorem|9] we can see from (40 1 that Rn and 
R21 are non-increasing functions of while R12 and P22 are non-decreasing functions. Therefore, the optimal 
all ™^ ^"ei are those resulting from the intersections between R\i^R\2 and ^21,^22, respectively. ■ 



C. Sum rate comparison with Noisy Network Coding 

Similar to the Gaussian channel case, we first analytically derive the optimal cr^ that maximizes the sum rate of 
noisy network coding for the fading TWRC. 
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Corollary 9. The optimal ct^ that maximizes the sum rate of the fading TWRC using noisy network coding is 
obtained similarly to the Gaussian case in Corollary [5] but with the following replacements: 
• Replacing a^i with a^i where 

-2 1 



"12 "2r 

Replacing Uei,(Je2 with Oei,d'e2 as in ( |46[ ) respectively. 

Replacing ag with dg which is obtained by solving the following equation: 

d 



where R12, R21 are defined in (|40| 



^_(i?i2 + i?2i) =0, (48) 



Proof The proof follows similar arguments as in the proof of Corollary [5] ■ 

Remark 20. and in ( |47] i and ( |48| ) can be evaluated using the Meijer G-function as shown in Appendix |l] 

Based on Corollary |9] and Theorem [TT] we can now obtain the following theorem for the condition that CF 
without binning achieves the same sum rate as noisy network coding for the fading TWRC. 

Theorem 12. Compress-forward without binning achieves the same sum rate as noisy network coding for the fading 
TWRC channel if and only if d'f^ > max((T^j^, ct^2)' ^here ct^ is obtained as in Corollary^and tr^j^, are defined 
in ( |43| ). 



Proof: Similar to the proof of Theorem 10 



D. Geometrical comparison 

In this section, we present the geometrical channel conditions for which CF without binning achieves the same 
rate region or sum rate as noisy network coding for both the Gaussian and fading two-way relay channels. 

In the following discussions, the corresponding fading channel parameters gf^ are related to the Gaussian channel 
parameters gl^ by the following equation: 

Qij = hij ■ Qij. (49) 

where hij ^ A/'(0, 1) and gij — d^j"'^^ represents the pathloss components for i,j e {1, 2, r}. 

1) Equal pathloss (5,1 — gir,gr2 = 32r,ff2i = 912)-' This channel configuration models large networks which 
consider the pathloss as a function of node locations. 

Figure |8] shows when CF without binning achieves the same rate region or sum rate as noisy network coding. 
We fix user 1 at point (—0.5, 0) and user 2 at point (0.5, 0). Let the pathloss exponent be a = 2. For the Gaussian 
channel. Region 1 illustrates relay locations for which CF without binning achieves the same rate region as noisy 
network coding, while Region 2 (the whole plane) is for the same sum rate. Regions 3 and 4 are the corresponding 
ones for the fading channel. We see that in the equal pathloss case, CF without binning achieves the same sum rate as 
noisy network coding on the whole plane for Gaussian channels (as shown in Corollary [6]). Both the same-sum-rate 
and same-rate-region regions for the fading channel appear to be larger than those for the Gaussian channel. 
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2) Reciprocity ((jri — 3ir:5r2 = 92r)- This channel applies when the nodes use time-division duplexing for 
which channel reciprocity holds. 

Let (jri = gir = l,5r2 = 32r — 2 and P = 10. In Figure [9] Regions 1, 2, 3, 4 correspond to the same 
representations as those in Figure [8] In this case, CF without binning achieves the same sum rate as noisy network 
coding for the majority of (312,521) fo'" ^oth Gaussian and fading channels. 

3) Uplink-downlink ((jri — gr2,9ir — g2r)- This channel configuration applies if nodes use frequency-division 
duplexing, in which the uplink pathlosses can be similar and the downlinks can be similar. 



Let (jri — gr2 — l,5ir — 52r = 2 and P ~ 10. In Figure 10 Regions 1, 2, 3, 4 also correspond to the same 
representations as those in Figure [8] In this case, CF without binning also achieves the same sum rate as noisy 
network coding also for the majority of (512,521) for both Gaussian and fading channels. The region in which CF 
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without binning achieves the same rate region as noisy network coding is larger for the fading channel than for the 
Gaussian channel. 

VII. Conclusion 

We have analyzed impacts of the 3 new ideas for compress-forward (CF) in noisy network coding (NNC): no 
Wyner-Ziv binning, relaxed simultaneous decoding and message repetition. For the one-way relay channel (single- 
source single-destination), no Wyner-Ziv binning alone without message repetition can achieve the NNC rate at 
shorter decoding delay. The extra requirement is joint (but not necessarily relaxed) decoding at the destination of 
both the message and compression index. However, for multi-source multi-destination networks such as the two-way 
relay channel (TWRC), we find that all 3 techniques together is necessary to achieve the NNC rate region. 

Under certain channel conditions, CF without Wyner-Ziv binning and without message repetition can achieve the 
same rate region or sum rate as NNC. Deriving these conditions explicitly for the Gaussian and fading TWRC, we 
find that the difference in rate regions between CF without binning and NNC is often small. Results also show that 
these two schemes achieve the same sum rate for a majority of channel configurations. The configurations for the 
same sum rates are more relaxed than for the same rate regions and also are usually more relaxed for fading than 
for Gaussian channels. These configurations may be useful in practice because of the short encoding and decoding 
delay in CF without binning. 

Appendix A 
Proof of Theorem[T] 

Assume without loss of generality that mj = 1 and fcj_i = kj = 1. First define the following two events: 

£;/fc,) = {«(fc,),y"(j + l))eTi")} 
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Then the decoder makes an error only if one or more of the following events occur: 

£ij ={{y:{H\)X{j),x-{l)) i T(") for all k, e [1 : 2"^-]} 

£2, ={(x;?(l),y"(j + l)) ^ri") or {x-{l),x-{l),y:^m,y-{j))^Tt^} 

^{^£[j{kj) and £2j{^, kj) for some kj 7^ l} (50) 
£ij ={£(j(l) and £2j{mj, 1) for some mj 7^ l} 
£5j —{^ijikj) and £2j{mj,kj) for some rrij 7^ l,kj 7^ l}. 

Thus, the probability of error is bounded as 

P{m, ^ 1, k, 7^ 1} < P{£,,) + P{£2, n £',j) + P{£^,) + P{£,,) + P(%)- 
By the covering lemma |5|, P{£ij) — as n — 00, if 

Rr> I{Yr\Yr\Xr). (51) 



By the conditional typicality lemma | |2T| , the second term P{£2j H £ij) as n ^ cx). 
For the rest of the error events, the decoded joint distribution for each event is as follows. 

£[jikj) ■.p{xr)p{y) 

^2j(l>^j) ■ P{x)p{Xr)p{yr\Xr)p{y\x, Xr) 
£2j{mj,l) ■P{x)p{Xr)p{y,yr\Xr) 
£2j{mj,kj) : p{x)p{Xr)p{yr\Xr)p{y\Xr), 

where nij 7^ l,kj 7^ 1. Using standard joint typicality analysis with the above decoded joint distribution, we can 
obtain a bound on each error event as follows. 
Consider £3^: 

p{£,,) = p{Uk^M^[,{k,) n kj))) 

< ^P(£(,(fc,))xP(f^^.(l,fc,)). 



Note that if kj ^ 1, then 



kj^i 



P{£[,ikj)) < 2-^Wx.;Y)-s(.)). 

= ^ P{x)p{Xr)p{yr\Xr)p{y\x,Xr) 

^ 2n{H{X,XrXr,Y)-H{X)-H(Xr)-H{Y,^\Xr)-H(Y\X,X,^)-3S(e)) 
_ 2n{H{Yr.Y\X.Xr)-H{Y^\Xr)-H(Y\X,X,^)-3S(€)) 
_ 2n{H{%\Y,X,X,^)-H{Yr\X,.)-3S(e)) 
_ 2-n{I{Y^;X,Y\Xr)-3S{e)) 
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Therefore 

which tends to zero as n — )• oo if 

Rr < I{Xr; Y) + !{%■ X, Y\Xr). 



Next consider Sij: 



Note that if mj ^ 1, then 



Therefore 



P{£4j) = P{U^,M^[j{l) n £!,j{mj, 1))) 



= ^ p{x)p{Xr)p{y,yr\Xr) 

(,r,.T,,y,,'y)eri"' 

_ 2'^{H{Yr,Y\X,Xr)-H{Y,Yr\Xr)-25ie)) 
_ 2-n{I{X;Y,Y,.\X,.)-26ie)) 



which tends to zero as n — )• oo if 



R < I{X;Y,Yr\Xr). 



Now consider S^j: 



P{£5j) = P{^m,^i Ufc,^i i£[j{kj) n S'^jiruj, kj))) 



(52) 



(53) 
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Note that if rrij ^ 1 and kj ^ 1, then 

= X! P(2:)p(a;r)p(yr|a;r)p(2/kr) 

_ 2n{H(Y\X,Xr) + H(Y,.\Y,X,Xr)-H(Y,.\Xr)-H(Y\X^)-3S{e)) 
_ 2-n{I{X:Y\X^)+I{Y,.;X,Y\X^)-3S{f.)) 

Therefore 

which tends to zero as rt — > oo if 

R + Rr< I{Xr] Y) + I{X; Y\Xr) + I{Yr] X, Y\Xr) 
= I{X,Xr;Y) + I{%;X,Y\Xr). 



Combining the bounds ( 5 1 1 and ( 54 1, we have 



R < I{X, Xr, Y) + l{Yr-, X, Y\Xr) - I{Yr;Yr\Xr) 

- /(X Xr-, Y) + X, Y\Xr) - I{Yr;Yr, X, Y\Xr) 
= I{X, Xr-, Y) - I{Yr.; Yr\X, Xr,Y). 

Combining (51 1, (52i and (53 1, (55i, we obtain the result of Theorem [T| 



(54) 



(55) 



Appendix B 
Proof of Theorem[3] 

Assume without loss of generaUty that mij — toi j+i = m2.j = 1 and fcj_i = kj = 1. First define the following 
two events: 

£[,ik,) = {ix-Ak,),y'^{j + i),xUl)) e Ti")} 

£^,{m,,„kj) = {{xUm2,,),x:{l),y-{k,\l),yUj),xUl)) e 
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Then the decoder makes an error only if one or more of the following events occur: 

={(y;'(fc,|l),y,"(j),<(l)) i T(") for all e [1 : 2"«-]} 
£2j ={(4'(l),yl'0- + l),x'/(l)) ^Ti") or {x^{l),x-{l),y-{l\l),y^{j),x-,{l)) ^ T^"-)} 

—[£[j{kj) and £2j{^, for some kj ^ 1} (56) 
={^y (1) and f2j(™2,j, 1) for some m2j ^ l} 

(^j) ^d £'2j{m2,j,kj) for some m2,j 7^ 1, fcj 7^ l}. 

Thus, the probability of error is bounded as 

P{m2,j ^ 1, kj + 1} <P{£xj) + P{£2i n ff,.) + P(%) + P(f4,) + P(f5,). 

By the covering lenoma, P{£\j) — )• as n — )• 00, if 

Rr>I{Xr\yT\Xr). (57) 

By the conditional typicality lemma, the second term P{£2j H £ij) ^ as n ^ oo. 

For the rest of the error events, the decoded joint distribution for each event is as follows. 

^Ijfe) ■ P{xi)p{Xr)p{yi\xi) 
£2j{'^,kj) -.pixi )p{X2 )p{Xr)p{yr \Xr)p{yi\X2, Xr, Xi) 
^2j("^2,j, 1) : p{xi)p{X2)p{Xr)p{yi,yr\Xr,Xl) 
^2j{'"T-2,j,kj) ■.p{xi)p{X2)p{Xr)p{yr\Xr)p{yi\Xr,Xi), (58) 

where m2,j ^ 1, kj ^ 1. Using standard joint typicality analysis with the above decoded joint distribution, we can 
obtain a bound on each error event as follows. 
Consider Ssj: 

P{£^j) = P(yjkM^[,{k,) n £'2,{\, kj))) 
<J2P{£[j{kj))xP{£^j{l,kj)). 

Note that if fcj ^ 1, then 

Pi^Ljihkj)) 

= ^ Pixl)p{X2)piXr)p{yr\Xr)p{yi\ Xl) 

(a:i,£C2,a;r,yr,J/l)eTi"' 

^ 2n{H(Xi,X2,X^,Yr,Yi)-H{Xi)-H(X2)-H(X^)-H(%\X^)-H{Yi\X2,X^,Xi)-4S(e)) 
_ 2n{H{Yr,Yi\X2,Xr,Xi)-H(Yr\Xr)-H{Yi\X2,Xr,Xi)-4S{€)) 

_ 2n(H{Yr\Yi,X2,Xr,Xi)-H{Yr\Xr)-i5{e)) 

^ 2-n{I{Yr;Xi,X2,Yi\X,.)-4Si€)) _ 
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Therefore 

< 2"^'- • 2-"(^(^'-;^il^i)-*(«)) • 2-"W*r;^i,^2,yi|^r)-45(e)) 
which tends to zero as n — )• oo if 

i?, < I{Xr;Yi\Xi) + I{Yr;XuX2,Yi\Xr). (59) 

Next consider S^j: 

P{£4j) = i^(U™,,,^i(fi,(l) n £!,j{m2,j, 1))) 
< ^ P(£:^,.(m2,,-,1)). 

Note that if m2,j 5^ 1, then 

P(4^.(m2,,-,1)) 

= ^ p(a;i)p(a;2)p(a;r)p(yi,yr|a;r,a;i) 

^ 2n{H(Xi,X2,Xr,Yr,Yi)-H{Xi)-H(X2)-H{Xr)-H{Yi,Yr\Xr,Xi)-35{e)) 
_ 2n{H{Yr,Yi\X2,Xr,Xi)-H{Yi,Yr\Xr,Xi)-35{e)) 
^ 2-"(^(^2;n,V;|^r,^i)-35(e))_ 

Therefore 

which tends to zero as n — )• 00 if 

R2<I{X2;Yi,Yr\Xr,X,). (60) 

Now consider £5^: 
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Note that if m2.j 7^ 1 and kj ^ 1, then 

P(4^.(m2,j,/c,)) 

= X! P(xi)p{x2)p{Xr)p{yr\Xr)p{yi\Xr,Xl) 

^ 2n(H{Xi,X2,X,^,%,Yi)-H(Xi)-H{X2)-H{X^)-H{%\X^)~H(Yi\Xr.Xi)-i5{e)) 

^ 2"(-H"C^'-''^il^2,Xr,Xi)-H(Y,|Xr)-H(yi|X,,Xi)-4<5(e)) 

^ 2n{H{Yi\X2,X,.,Xi)+H{%\Yi,X2,Xr,Xi)-H(Y,.\X^)~H{Yi\X^,Xi)^4S{e)) 

^ 2-niI(X2;Yi\XuXr)+Ii%:Xi,X2,Yi\Xr)-4:5{e)) 

Therefore 

P{£5j) < 2"'^'^ ■ 2"-"'- • 2""(-'"(^'-'^il^i)-''('=)) • 2-"(-f(-^2;yi|Xi,Xr)+/('fV;Xi,X2,Yi|X,)-45(e)) 
which tends to zero as rt 00 if 

-/(X2,x,;ri|Xi) + /(y,;Xi,X2,yi|x,). (6i) 



Combining the bounds (57i and (61 1, we have 

R2 < I{X2,Xr;Yi\Xi) + IiYr;Xi,X2,Yi\Xr)-I{Yr;Yr\Xr) 

= IiX2,Xr:Yi\Xi) - IiYr;Yr.\Xi,X2,Xr,Yi). (62) 

Combining the bounds ( [60| and ( [62| , we obtain the rate constraint on i?2 in Theorem |3] Similar for From p7| ) 
and (|59|, we obtain constraint ( [Tol i. 

Appendix C 
Proof of Theorem|4] 

We use a block coding scheme in which each user sends 6—1 messages over b blocks of n symbols each. 

1) Codebook generation: Fix p{xi)p{x2)p{xr)p{yr\xr,yr)- We randomly and independently generate acodebook 
for each block j ^ [1 : b] 

• Independently generate 2"-'^i sequences a;"(TOi.j) ^ Y[i=iPi^ii)' where mi,j E [I ; 2"^'^]. 

• Independently generate 2"^^ sequences 2^2 (™2j) ~ nr=i ^'(■^2i)' where m2.j £ [1 

• Independently generate 2"^'' sequences ^ YYi=iPi^ri), where qj^i e [1 

• For each (7j_i e [1 : 2"^"^], independently generate 2"^^"^+^' ) sequences rj|(7j_i) ~ Y[i=iPiyri\^ri{qj-i 
Throw them into 2'"-^''' bins, where qj E [1 : 2"^''] denotes the bin index and rj e [1 : 2"^'-] denotes the 
relative index within a bin. 

2) Encoding: User 1 and user 2 transmits a;"(mi j) and x5(TO2.j) in block j separately. The relay, upon receiving 

finds an index pair {qj,rj) such that 

{y-{q„r,\q,.^),y-{j),x-{q,^^)) G tJ"). 
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Assume that such (q^, rj) is found, the relay sends x"{qj) in block j + 1. By the covering lemma, the probability 
that there is no such {qj,rj) tends to as n oo if 



Rr + K > I{Yr:Yr\Xr). 

3) Decoding: At the end of block j, user 1 determines the unique qj^i such that 

(4'fe-i),yi(j),2;^(mi,,))eT("). 
Similar for user 2. Both succeed with high probability if 

Rr < mm{I{Xr;Yi\Xi),I{Xr;Y2\X2)}. 
Then user 1 uses — 1) to determine the unique fj_i such that 

Similar for user 2. Both succeed with high probability if 

K < min{/(i;; Xi,Yi\Xr), I{Yr; X2, Fal^r)}- 
Finally, user 1 uses both — 1) and — 1) to determine the unique 1122 j-i such that 

(a:^(m2.,_i),yr('?.-i,^.-i|'7.-2),y5'(j - l),x^{q,-2),xUnii,,-i)) € T^. 
Similar for user 2. Both succeed with high probability if 

Rl<I{X,;Y2X\X2,Xr) 
R2<IiX2;Yi,Yr\Xl,Xr). 



(63) 



(64) 



(65) 



(66) 



The constraint (12i comes from combining (63 1, (64i and (65 1. 

Remark 21. We note an error in the proof in |14|. In p4) , when user 1 determines the unique fj-i, it is stated 
that it succeeds with high probability if 



K<I{Yr;Y,\X,,Xr), 



(67) 



which corresponds to step ( |65[ ) in our analysis. However, this is incorrect since the decoded joint distribution of 
this error event is p{xi)p{xr)p{yr\xr)p{yi\xi,Xr)- Therefore, the error probability can be bounded as 



P{£) = 



E 



p{xi)p{Xr)p{yr\Xr)piyi\xi,Xr) 



^ 2n(H(Xi,X^,Y^,Yx)-H(Xi)~H(Xr)~H(Y^\X^)-H(Yi\Xi,X^)-3S(e)) 
^ 2-n{I(Y,.-XuYi\X^)-:iS(c)) 



which tends to zero as as n — > 00 if (roSb is satisfied instead of (roTb. 
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Appendix D 
Proof of Corollary[T] 

The codebook generation and encoding is the same as that in Theorem [3] The decoding rule is changed as 
follows: in block j + 1, user 1 finds a unique such that 

(x^(m2,,0,4'(%-i),y"(%l^.-i),yr(j),a;r(mi,,)) e ri") 

and {x^{k)^yi(j + S tJ") 

for some pair of (fcj_i, kj). Next we present the error analysis. 

Assume without loss of generality that niij = mij+i = m-zj = 1 and fcj_i = kj = 1. First define the following 
two events; 

£[^(k,) = {{x-{k,),y-{j + l),xUl)) e T(")} 
£^^{m2,„k„k,^,) = {{x^{m2,,),x:{k,.,),f;{k,\k,.,),y-{j),x1{l)) € Ti")}. 

Then the decoder makes an error only if one or more of the following events occur: 

={{yl\k,\l),y-{j),x^(l)) i Ti") for all k, e [1 : 2"«-]} 

^{{x-(\).yl{3 + \).xl(X)) i Ti") or (a:^(l), yJ^Q'), i Ti")} 

and £2j{m2j, 1, 1) for some ni2j ^ l} 
fsj —{£[j{kj) and £2j{m2j,kj, 1) for some m2j 7^ l,A:j 7^ l} 
£(ij and f2j(w2j, 1, fcj-i) for some maj 7^ l,/i:j-i 7^ l} 

frj and £2^(1712 j,kj,kj^i) for some r7i2j 7^ l,kj 7^ 7^ l}, 

where £ij , f 2j are the same as in (|56]l in the proof of Theorem [3] (Appendix |B]); f 3^ in (|56]l is not an error here. 
£4j and £5^ are similar to £4^ and £5^ in (|56|. fej and are new error events. 
The probability of error is bounded as 

P{^2,j ^ 1} < P{£i,) + P{£2j n £!^) + P{£,j) + P(4) + P{£,,) + P{£j,). 
Similar to the proof of Theorem |3] in Appendix [b] by the covering lemma, P{£ij) — J- as n — 00, if 

Rr > IiYr;Yr\Xr). (68) 

By the conditional typicality lemma, the second term P{£2j H £ij) — as n — oo. 
By the packing lemma, P{£ij) — ^ as ?i — > oo if 

R2<I{X2\Y^X\Xr:X^). (69) 

Similarly, P{£^j) — > as n — > oo if 

R2+Rr< I{X2,Xr;Y^\X^) + I{Yr;XuX2,Y^\Xr). (70) 
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For the new error events Sgj and S^j, the decoded joint distributions are as follows. 

f2j('^2j, : P{xi)p{x2)p{Xr)p{yr\Xr)p{yi\xi) 

^2i(™2j,fci,fcj-l) : p{xi)p{x2)p{Xr)p{yr\Xr)p{yi\xi), (71) 

where m2j ^ 1, kj ^ 1, fcj_i 7^ 1. Using standard joint typicality analysis, we can obtain a bound on each error 
event as follows. P(£Qj) as n 00 if 

R2+Rr<I{X2,Xr;Yi\Xi)+I{Yr;Xi,X2,Yi\Xr). (72) 

P{£'!j) — >■ as n — >■ 00 if 

i?2 + 2i?, < /(X,,; FilXi) + /(X2, X,; Y^\X{) + /(t ; Xi, X2, Fi (73) 

Combining the above inequalities, we obtain the rate region in Corollary [T] Compared to the rate region of noisy 
network coding in ([TSj, the only new constraint is ( |73] l, which occurs when both compression indices are wrong 
in addition to a wrong message. 

Appendix E 
Proof of Corollary[2] 

Assume without loss of generality that mij- = mi^+i = rn2j = 1 and k2j-2 = ^2^-1 = ^2^ = 1- First define 
the following three events: 

^;,(fc2,) = {(.<(fc2,),y?(2j + i),<2,+i(i)) G 

£'2,{m2,,M,Mj-i) = {{xl2,{m2,,).x-,{k2,-i),y^{k2^k2,-i).yU2j),xl2^{l^ € Ti")} 

f^,(m2,„fc2,-l,fc2,^2) = {ixl2^_A^2,,),X^{k2,-2),y:{k2,^l\k2j-2),yn^J " l),<2,-l(l)) ^ ^^i"' } ■ 

Then the decoder makes an error only if one or more of the following events occur: 

fi, = {{y-{k,\l),y-{j),x-{l)) i Ti") for all k, e [1 : 2"«i} 
£2, = {{x-(\),ym + l),<2,+i(l)) ^ ri") or 

(^2,2,(l),<(l),2/"(l|l),yr(2j),<2,(l)) ^ ri") or 

(^2,2,-i(i),^"(i),y"(i|i),yr(2j- i),<2,-i(i)) ^ T.^"^} 

= {'S'ii(l)''^2j("^2j, 1, 1) and £'^j{m2j, 1, 1) for some m2j ^ 1} 
^4, = {'^ij(l):'^2j("^2j, 1, 1) and £3j(to2j, 1,^2^-2) for some TO2j 7^ 1,^2^-2 7^ l} 
^5, = {'^^y(l),'^^2j("^2j,l,^2i-i) and f3^(m2j,fc2j-i,l) for some m2j ^ 1,^2^-1 ^ 1} 
fgj = {£[j{k2]),£2j{'m2,],k2j,l) and f3j(m2j, 1, 1) for some m2j 7^ 1, fc2j ^ l} 
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= {£ij{k2j),£2ji'"^2,j,k2j,k2j-i) and £^^{m2.j,k2j-i,l) for some ^ l,fc2j 7^ 1,^2^-1 7^ l} 
= {Sij{k2j),S2j{m2j,k2j, 1) and £'^j{m2,j, l,k2j-2) for some TO2j ^ l,A:2j ^ l,^2i-2 7^ l} 
= {£y(l),£2j("i2j, 1, fc2j-i) and f3j(rn2j, ^2^-1, ^2^-2) for some TO2j 7^ l,k2j-i ^ l,k2j-2 ^ 1} 
£[oj = {£'ij{k2j),£'2jim2,j,k2j,k2j-i) and (m2j, fc2j-i, ^2^-2) 
for some m2j 7^ 1, fc2j 7^ 1, fc2j-i 7^ 1, ^2^-2 7^ l} 

Similar to the proof of Theorem |3] in Appendix [b] by the covering lemma, P{£ij) — as n — 00, if 

Rr > IiYr;Yr\Xr). (74) 

By the conditional typicality lemma, the second term P{£2j H £lj) — >■ as rt oo. 

Let symbol "*" represent the wrong message or compression index. For I e {2j, 3j}, similar to ( |58] l and ( |7T| l, 
the joint decoded distributions for the rest of the error events are as follows. 

£[j{*) : p{xi)p{xr)p{yi\xi) 
^;'(*, 1, 1) : P{.xi)p{x2)p{xr)p{yi 

•) Vr I ; -^1 ) 
: P{xi)p{x2)p{Xr)p{yr\Xr)p{yi\xi) 
*, 1) : P{xi)p{x2)p{Xr)p{yr\Xr)p{yi \Xr, Xl) 
■ P{xi)p{x2)p{Xr)p{yr\Xr)p{yi\xi). 

Using standard joint typicality analysis, we can obtain a bound on each error event as follows. 

P{£lj) as n -> cx) if 

2R2<2I{X2;YiX\Xr,Xi). (75) 

P{£lj) ^ as n ^ oo if 

2R2+Rr < IiX2;YiX\Xr,Xi)+IiX2,Xr;Yi\Xi)+IiYr;Xi,X2,Yi\Xr). (76) 
P[£lj) as n oo if 

2R2 +Rr< I{X2,Xr; FilXi) + I{Yr;Xi,X2, Yl \Xr) + I{X2; Yl \Xi,Xr) + I{Yr; Xi,X2, Fl \Xr). (11) 

P{£^j) as n oo if 

2R2+Rr < IiX2;Y,,Yr\Xr,X,) + I{X2,Xr;Y,\X,) + IiYr;X,,X2,Y,\Xr). (78) 

P{£jj) as n oo if 

2i?2 + 2Rr < I{Xr;Yi\Xi) + I{X2, Xr ; Fi |Xi ) 

+ IiYr;Xi,X2,Yi\Xr) + IiX2;Yi\Xi,Xr)+IiYr;Xi,X2,Yi\Xr.). (79) 

P{£lj) — !• as n oo if 

2i?2 + 2i?, < 2 [/(X2 , X, ; Fi I ) + /(t ; Xl , ^2 , Fi I X, )] . (80) 
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P{£gj) ^ as n ^ oo if 

2R2 + 2R, <2[I{X2,Xr;Y,\X,) + I{Yr;X,,X2,Y,\Xr)]. (81) 

P{£loj) as rn- CX3 if 

2R2+3Rr< I{Xr;Yi\Xi) + 2[IiX2,Xr;Yi\Xi) + I{Yr;Xi,X2,Yi\Xr)]. (82) 

Combining the above inequalities, we obtain the rate region in Corollary |2] The extra rate constraints ( |24c[ ) and ( |24f| ) 
come only from combing ( (82] i with ( |74] i. Again we see the boundary effect when the message and all compression 
indices are wrong. 

Appendix F 
Proofs of Corollary|5]and Corollary[6] 

A. Proof of Corollary [5] 

Our objective is to find the optimal cr^ which maximizes the sum rate 

s{a^) = max{0,min{i?ii(CT2),i?^2(CT2)}} +max{0,min{i?2i(CT2),i?22(fT^)}} ■ 



Recall that we have assumed a^i > al2, where crg]^,(Tg2 ^re defined in (33 1. Note that both i?ii((T^), i?2i(o'^) are 
non-increasing and i?i2(o'^), i?22(o'^) are non-decreasing. Also, 

i?n(^e'l)=^12(^el) 
R2l{cTl2)^R22{<yl2)- 

Therefore, the problem of maximizing s(a^) is equivalent to 

max q{(j^) = max{0, i?i2(cr^)} + i?2i(CT^) 
s.t. CT^<cr2^, 

^2 > al2. (83) 

Note that i?i2(crfi) = and Ri2{a'^) < for e (O,^^^), Ri2{cr^) > for (t^ ^ (o-2^,oo). Therefore, the 
optimization problem in ( [83] l can be derived into the following two cases: 
Case 1: < a^2 

In this case, the objective function ^(cr^) can be simplified to q{<j'^) = Rviif^"^) + R^iic'^), which is continuously 
differentiable for € [o'e2; "'eil- Thus the optimization problem is equivalent to 

min f{(T^) = -Ri2{a'')-R2i{a^) 

s.t. Ci(cr2) = (Tgi - > 0, 
C2{o^) = (y^ -ol2>Q. 
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Form the Lagrangian as C.{a\ Ai, A2) = /(c ) — \\Cx[p ) ^ '^2C2(o' )• With the KKT conditions, we have: 

v<^2/:(cr^i,Ai, A2) = 0, 

Ai,A2 > 0, 
^iCiCo-wi) = 0> 

A2C2Ki)=0. (84) 



By solving the above conditions, the optimal aj^^ for this case is characterized as in (37i. 

Case 2: af^ > (Tg2 

In this case, the objective function q(<j'^) is no longer continuously differentiable for cr^ £ ['^e2^'^ei\- To solve 
this problem, we divide this interval into two parts. When cr^ € ['^e2i '^zi)^ '^he objective function is simplified to 
q{cr^) — -R2i(o'^) and is maximized at ~ <t^2- When cr^ e [cr^ijCei]' the objective function is simplified to 
q{a^) — i?i2(CT^) + -R2i(o'^) and is continuously differentiable for ct^ £ Wli^f^eil- With the KKT conditions, the 



optimal cr for this case is characterized as ct^j (38 1. Combining the two intervals, the optimal aj^ for this case 
can be characterized as in (l39li. 



B. Proof of Corollary |6] 

From Corollary |5] and Theorem 10 we have: 



If all — '^e2^ then the two schemes achieve the same sum rate if and only if at least one of the following three 
conditions holds: 



^2 ^ 2 



< ail < ^: 



(85) 
(86) 
(87) 



For the channel configuration of g^i = 5ir,5r2 = 92ri92i = 912, we can show that either (861 or (87i will hold. 
If (T^i > "'62' we can show that i?2i(o'g2) < Ri2{<^li) + R2i{<^li) always holds. Therefore, according to (38 1 



and (39 1, the optimal aj^ can be characterized as: 



if > > 0, a% 



a„ 



if al > all or < 0, < = ali- 

-2 ^ -r2 .,,0 nUtcin .-r'^ <' ,-r2 



Since either (861 or (87i holds and a-^i < a^i, we obtain a^i < aj^. According to Theorem 10 the two schemes 
then achieve the same sum rate. 



Appendix G 
Proof of Theorem[TT] 

From the assumption of CSI available at each node, the constraint Ru in Theorem [3] can be expressed as 

Rll<I{Xi;Y2,Yr\X2,Xr) 

= I{Xi; Y2, /12I, h2r, hrl, hr2,Yr\X2, Xr) 
— "* liXi; Y2, Yr\X2, Xr, /l21, ^2r, hrl, hr2) 

= h{Y2, Yr\X2, Xr, /l21, ^2r, ^rl, hr2) — h{Y2, Yr\Xi, X2, Xr, /l21, /i2r, hrl, hr2) 



Xi 



Xi + Zr 



hri,h21 - h{Z2,Zr + Z) 



\ \ "-12 / \"'lr / 

where (a) follows since each hij is independent from all X^. Similarly, we obtain i?2i as 



R21 < h 



hi2 
"12 



X2+Zi\, 



hr 



X2 + z, + z 



hr2,hl2 - h{Zi,Zr + Z). 



Moving to i?i2, we can express it as 

R12 < I{Xi,Xr; Y2\X2) - I{Yr; Yr\X^,X2, Xr, Y2) 

= I{Xi, Xr; Y2, h21, /l2r, hrl, hr2\X2) — I{Yr; Yr , hrl, hr2\Xi, X2, Xr, Y2, /l21, ft-2r, hrl, ^r2) 
= I{Xi, Xr', Y2\X2, ft.21, h2r, hrl, ^^2) — I{Yr', Yr , hrl, hr2\Xi, X2, Xr, Y2, /l21, ft-2r, hrl, hr2) 
= h{Y2\X2, /l21j h2r) — h{Y2\Xi, Xr, X2, /l21i h2r) — h{Yr\Xi, X2, Xr, Y2, ft.21j h2r, hrl, ^r2) 
+ I{Yr\Xi, X2, Xr, Y2, h21, h2r, hrl, hr2, Yr) 



,a/2- 



= h 

Similarly, we obtain i?22 as 

R22<hi 



^21 ^2r 

Xi + —jTrXr + Z2 



1/2 ' 



h21, h2r - h{Z2) - h{Zr + Z) + h{Z). 



^^7X2 H — :!r7^Xr + Zi 



ja/2' 



hl2,hir - h{Zi) - h{Zr + Z)+ h{Z). 



'-12 "Ir 

Moving to the compression rate constraints, we obtain 



IiYr;Yr\Xi,X2,Xr,Yi) < /(X,;Yi|Xi) 

^ h{Zr + Z) - h{Z) < I{Xr;Yi\Xi,hi2,hir,hrl,hr2) 



^ h{Zr + Z)- h{Z) < h -^X2 + - 

\di-r d 
Similarly, the second constraint is equivalent to 

IiYr;Yr\Xi,X2,Xr,Y2) < /(X,;f2|X2) 

<^ h{Zr + Z)- h{Z) < h 



a/2 



Xr + Zi 



hi2,hi 



ja/2 

■'12 



X2 + Z1 



/121 ^2r 

Xi H —JTrXr + Z2 



j"/2' 



a/2 ' 



j"/2 



Xl 
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Regarding the optimal input distributions, although Gaussian distributions are not necessarily optimal for the 
compress-forward strategy, we choose Xi, X2, Xr and Z to be Gaussian for simplicity. With this assumption, 
equations ( 88||9T] l become as those in ( [40| |5|. Hence, we obtain the rate constraints in (41 1. Moreover, constraints 
(|92l I93I1 become 



C{l/(T^) <e{c 



C{l/a^) <e{C 



P 



\h21l 



P 



P 



1 + 



(94) 



From d94ll, we obtain the constraints in (HZb. 



Appendix H 
Proof of Corollary[7] 

Since \hi2\ is Rayleigh, then |/ii2p is exponential with mean A ~ l/£'[|/ii2p]. Let 7 = u + w, where u and v 
are independent exponential random variables with parameters A„ and A^,, respectively. Then the CDF of 7 is given 
as II22I 



^(7) 



1 - 



A7 



1 - (1 + A7)e^'^, 
Then, the pdf of 7 for A„ 7^ \y can be expressed as 



7 An ^ A^ 
Am = A„ 



A,, A,; 



,-A„7 _ „-A„7] 



In ||23l, it is shown that 



1 _7 1 
log(l + 7)-3e ^^7=1 — o- 



G' 



6.2 

4,6 



-0.5,0,0,0.5 



(27) 



2 10,0.5,-0.5,0,-0.5,0 



(95) 



(96) 



can be expressed as 



\h \ P \h \ P 

To evaluate Rn in (|40|l, set ui = '-^ — , vi = (i+g-^) '^^'^ 7 = + ''^i- Then, by using (95 1 and (96 1, Ru 



Rii 



A,,, A,: 



log(l + 7) • ■ !^ [e-^"i^ - e-^-^] d7 



which can be solved as in (|44]i. Similar derivation holds for the other rates. 



Appendix I 

Evaluate the expressions in Corollary|9] 
Staring with a-"^^, we use the second equation in (44i to obtain the same a^i in (47 1 with 



^1 



47r^ln2(At,3 - A„J 



X G' 



6.2 



Am 



-G' 



6,2 



(97) 
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Next, the maximum sum rate is obtained by solving the following problem: 

max Ri2 + R21 

a 

S.t. Cl = CTgi — Cr^ > 0, 

C2 = - al^ > 0. 

Since the constraints ci and C2 are inactive for the interval (0-^2, ^ei)' their corresponding Lagrange multipliers are 
equal to zero and the optimal a is obtained by taking the derivative of R12 + R21 with respect to a, which can be 
expressed as 

2 , 9i?2i 



Since 



3i?2i i9i?2i i9A„ 



2d^^a dR2i 

we can express the rate R21 as R21 + R21 where 



R. 



■21 



G' 



'6,2 

4,6 



2 



and 



■21 



47r-v/7rln2(A^2 - A^J 



G 



6,2 
4,6 





Op" 




6,. 



2 

47r-v/7rln2 (A^^ - AuJ 

^ A., 2 

47r-v/7rln2 (A^^ - AuJ 

= • Fi • F2 



{Q'-'-')Gli \q III 





Op 







(98) 



(99) 



(100) 



with 



Then, we have 



W 



dR 



21 



A„ 



47r-v/7rln2 

2 

(At,2 — Au^) 

l-0.5\y-<6,2 



F2 = {Q'-^-')Gl 



— A,, 



Q\t: 



G 



6,2 



SA„, (47r\/^ln2)(A„, -A„J2 4,6 





Op 








6,. 



and the derivative of R21 can be expressed as 

9^21 



dQ dXy 



'dXy 



(101) 



(102) 
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where each term can be expressed as 



dF2 {a) ^-0.5^6,2 

50 " ~ ^ ^4-6 



^ 1-0.5,0.0,-0.5 



dQ 

dXv^ 
dFi 



A 



f 2 

2 



with (a) follows from the relationship 

dz 



m,n ( \ap\ _ ~ap^m,n ( lai • • ,ap_ i ,ap- 1 \ ^ 



(103) 



(104) 



By substituting ( |103| l into ( 102i and combining it with ( 101 1, we obtain 

dR2i 



(47r0Fln2)(A,„ - A^J 



A, 



2 *^0,^ 





Op 


''^•[t2 






A^2 



4,6 



'"2 

2 



2G 



4,6 



(105) 



Finally, by substituting ( 105 i into (99 1 and by setting (98 i= 0, is obtained by solving the following equation: 



1 = 



(4^V^ln2)£;[|/i,2P]P(A., - A„J 



A, 



'^i'2 ^6,2 

"TTli 4,6 





Qp" 


^U2 






Xv2 Xu2 



G' 



4,6 



0/^6,2 
~ ^'-^4,6 



'f2 

2 



(106) 



where = [-0.5, 0, 0, 0.5], 6, = [0, 0.5, -0.5, 0, -0.5, 0] and Zp = [-0.5, 0, 0, -0.5]. 
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